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* homogeneity 
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o non-linear 


* notsatisfying above 


u Examples 
o linear 
* negatives 
o non-linear 


* gammas 
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o windowed signal (kernel) is not reversed 
o sliding vectors dot product 
o orthogonal signals are uncorrelated 
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Correlation % Convolution 


= Correlation 
o measures similaritv between the two signals 
o windowed signal (kernel) is not reversed 
o sliding vectors dot product 
o orthogonal signals are uncorrelated 


= Convolution 
o measure the effect of one signal on the another 
o windowed signal (kernel) is reversed 


° for symmetric kernels convolution = correlation 
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u Correlation u Convolution 
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credit: wikipedia 
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u Correlation u Convolution 
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u Correlation u Convolution 
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= Correlation = Convolution 
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R(x) = f(x) « g(x) 
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9:1 
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u Correlation u Convolution 


ши PON — ши 
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ПК NE 
вс) - Гај») | A Gla) Це) « a) 
R(x) = |. f(z)g(a + z)dz G(x) = Г f(z)o(z - z)dz 
9:1 
МИ IN 
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Correlation % Convolution 


u Correlation u Convolution 


fxg fxg 
f FI “S/N _ f | | Р З 

SN [NL | Ма SN Al Ги 
R(x) = f(x) + g(a) G(x) = Хе) * g(x) 


R(x) = Г f(z)g(a + z)dz G(x) = Г f(z)g(x – z)dz 


(е; 
x 


ак 
EUM 
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Correlation % Convolution 


u Correlation = Convolution 


fg fxg 
f FI to] y... ў | | 


EN а ма SN. A m 
_ ЧЕ Я | [И 


R(x) = f(x) * g(x) G(x) = f(x) х g(x) 
R(x) = |. f(z)g(a + z)dz G(x) = Г f(z)g(x – z)dz 
0:1 / ) g *f 
NI | ІК | МО 


EUM EU 
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o filtering algos internally use it 


* w need to be appropriately reflected before filtering 


EE604: IMAGE PROCESSING 


Correlation & Convolution 


u 20 correlation 
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(wx f)(x,y) = У, . 


5--аі-- 


о cross-correlation 
o filtering algos internallv use it 


° w need їо be appropriately reflected before filtering 


(we f)G.y) є У, У шк) (ху) 


s--at--b 
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Correlation & Convolution 


= 20 correlation 
о cross-correlation 
10 ~ х,у) = 14415,1)/(Х45,УуУ-41 
o filtering algos internally use it ( Ру) У > (ЎЎ уа) 


s--at--b 
* w need to be appropriately reflected before filtering 


= 2D convolution 


РИМУ (ож оу) = У, У, иу sy 


s—-at—— 
т-1 it-1 
o a = —,b = — 

2 2 

e a,b are assumed to be odd integers 


“ note the kernels do not depend оп (х,у) 
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Correlation % Convolution 


a b a b 
(70 F) (, Y) = У, > w(s,t)f(x+s,y +t) (wx f)(x,y)= У, У, wG.t)f(x- sy - t) 
s=—at=— s--at--b 
Property Correlation Convolution 
Commutative — f*g= gx ў 
Associative — у ж(ажп)=(јжајжћ 


Distributive f*(g-h)-(f*g)-*(f*h) f*(g-h)-(f*g)(f*h) 
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Filtering 


u Image filtering 
o spatial filtering 


o convolving a kernel with an image 
o filtering: g(x,y) = (wx f)(x,y) 


ЕЕ604: IMAGE PROCESSING sandhan@iitk.ac.in 


Filtering 


u Image filtering 
o spatial filtering 


o convolving a kernel with an image 
o filtering: g(x, y) = (wx , у) 
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o filtering the filtered 
o use properties 


° commutative & associative 
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= Image filtering 
o spatial filtering 


o convolving a kernel with an image 
o filtering: g(x, y) = (wx , у) 


= Multistage filtering 
o filtering the filtered 


Filter-2 
o use properties 


° commutative & associative 


ЕЕ604: IMAGE PROCESSING sandhan@iitk.ac.in 


Filtering 


Input Filter-1 


= Image filtering 
o spatial filtering 


o convolving a kernel with an image 
o filtering: g(x, y) = (wx , у) 


= Multistage filtering 
o filtering the filtered 


Filter-3 
o use properties 


° commutative & associative 
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Filtering 


a Image filtering Input Filter-1 


o spatial filtering 


o convolving a kernel with an image 
o filtering: g(x, y) = (wx , у) 


g(x,y) = изхи; хил ж f (x, У) 


= Multistage filtering 
o filtering the filtered 
o use properties 


° commutative & associative 
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Filtering 


a Image filtering Input Filter-1 


o spatial filtering 


o convolving a kernel with an image 
o filtering: g(x, y) = (wx , у) 


g(x,y) = W3 ж хил ж f (x, У) 


= Multistage filtering (из ж w2 * w1) ж f (x, У) 
o filtering the filtered 
o use properties 


° commutative & associative 


ЕЕ604: IMAGE PROCESSING sandhan@iitk.ac.in 


Filtering 


a Image filtering Input Filter-1 


o spatial filtering 


o convolving a kernel with an image 
o filtering: g(x, y) = (wx , у) 


g(x,y) = W3 ж W2 хил ж f (x, У) 


= Multistage filtering (из * w2 ж w1) ж f (x, У) 


o filtering the filtered (w1 ж Wo x из) ж f (x, y) 
o use properties 


° commutative & associative 
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Filtering 


a Image filtering Input Filter-1 


o spatial filtering 


o convolving a kernel with an image 
o filtering: g(x, y) = (wx , у) 


g(x,y) = W3 ж W2 хил ж f (x, У) 


= Multistage filtering (Wak Wa Wa JA f x y) 
o filtering the filtered (w1 ж wW ж w3) ж f (x, y) 

o use properties 
* commutative & associative g(x, y) = у ж f (x, y) 


W = Wi * Үүд ж W3 
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Filtering 


= Filter 
o kernel, mask, window, template 
o W(i,j) or k(ij) Vij Є Мк, K- kernel size 
° K:determine neighbourhood of operation 


° w(i, j): filter coefficients - determine nature of the filter 
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Filtering 


= Filter 
o kernel, mask, window, template 
o W(i,j) or К(і,)) Vi,j Є Мк, К- kernel size 
° K:determine neighbourhood of operation 


° w(i, j): filter coefficients - determine nature of the filter 


u Nature of a filter 


o neighbour interactions 


o filter coefficients define severity of interaction 
o smoothing 
o sharpening 
o noise handling capacity 
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Filtering 


Source pixel 


(-1x3) + (0x0) + (1х1) + 


(-2х 2) + (0x6) + (2х2) + 


(-1х2) + (0х4) + (1x 1) 2-3 


Destination pixel 
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u Paddings 


Source pixel 


о Zero 


(-2х 2) + (0x6) + (2х2) + 


(-1 х 3) + (0x0) + (1х1) + 


o mirror 


(-1х 2) + (0х4) + (1x 1) 2-3 
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Filtering 


« Зерагаріе kernels T 3 1 
o a kernel in a matrix form can be represented ш- 1 1 1 
as outer product of two vectors 


o w = ит? 
° цетхі 
° eNN 1 


e sq. kernels w-uu/,wemxm 


EE604: IMAGE PROCESSING sandhan@iitk.ac.in 


Filtering 


о а kernel in a matrix form can be represented = 111 


« Separable kernels | 1 1 
as outer product of two vectors 


o w = uur 
° цетхі 
° репхі 


° sq.kernels у = uu, w € m xm 


u Advantage: separable kernels 
o computationally fast 


° outer product of vectors is same as their 20 conv 
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« Зерагаріе kernels T 1 1 
о а kernel in a matrix form can be represented = 111 
as outer product of two vectors 
o w = шт 
° цетхі 
e venx1 
. 84. Kernels w = uu, w € m xm 1 1 
c= 1 r—jl 
l 


u Advantage: separable kernels 
о computationally fast 


° outer product of vectors is same as their 20 conv 
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Filtering 


= Separable kernels 1 1 1 
o a kernel in a matrix form сап be represented ш- 111 
as outer product of two vectors 
o w = uv" 
e цетхі 
e v€nx1 
. 84. Kernels w = uu, w € m xm 1 1 
с = г-|1 
| 1 


u Advantage: separable kernels 
о computationally fast 


° outer product of vectors is same as their 20 conv 


ef =| ill | =|; "E 
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= Separable kernels 


o a kernel in a matrix form can be represented 
as outer product of two vectors 10 = Wi * 105 
ow = шт 
° цетхі 
e venx1 


° sq. kernels w-uu/,wemxm 
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o a kernel in a matrix form can be represented 
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= Separable kernels 


o a kernel in a matrix form can be represented 
as outer product of two vectors 


ом = ци? 
° цетхі 


° ve€nx1í1 


° sq.kernels w-uu/,wemxm 


u Advantage: separable kernels 
o computationally fast 


* outer product of vectors is same as their 2D conv 


° image: M x N 
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= Separable kernels 
o a kernel in a matrix form can be represented 


as outer product of two vectors 10 = W жи, 
o = uv" 
e цетхі 
"PERAI юж f = (% kao.) f 


° 84. kernels w = uu, w € m xm 


= (10, * 701) ж f 
u Advantage: separable kernels 
o computationally fast 


e outer product of vectors is same as their 2D conv 


° image: М x N 


sandhan@iitk.ac.in 


ЕЕ604: IMAGE PROCESSING 


Filtering 


= Separable kernels 
o a kernel in a matrix form can be represented 


as outer product of two vectors 10 = W жи, 

o = uv" 
e цетхі 
° venx1 wk f = (0 жар,)Ж f 
° sq.kernels w-uu/,wemxm 

= (10 жи, ) ж f 
u Advantage: separable kernels 
o computationally fast = W, Ж (10, ж f) 


° outer product of vectors is same as their 20 conv 


° image: M x N 
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Filtering 


= Separable kernels 
o a kernel in a matrix form can be represented 


as outer product of two vectors 10 = W жи, 
o = uv" 
e цетхі 
"PERAI юж f = (% kao.) f 


° 84. kernels w = uu, w € m xm 


= (10 жи, ) ж f 
u Advantage: separable kernels 
o computationally fast = W, Ж (10, * 7 
° outer product of vectors is same as their 2D conv 
° image: M x N 


= (w, * f)* w, 
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Filtering 


= Separable kernels 
о а kernel in a matrix form can be represented 


as outer product of two vectors 10 = W жи, 
o = uv" 
e цетхі 
үй d wxf-(w Жао, )Ж f 


e sq. Kernels w = uuf, Sm m 


= (10 N 201) ж f 
u Advantage: separable kernels 
o computationally fast = W, Ж (10, * 7 
° outer product of vectors is same as their 20 conv 
° image: M x N 


= (w, * f)* w, 


mn 


. advantage factor = 
m+n 
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Filtering 


u Box filter 
o smoothing filter 
o lowpass filter 
o averaging filter 
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Filtering 


u Box filter 
o smoothing filter 
o lowpass filter 
o averaging filter 


u Use cases 


o random noise reduction 
° reducing sharp transitions іп intensity 
* favours blurring along perpendicular directions 
o reduce aliasing 
* smoothing prior to resampling 
o reduce quantization noise 
o reduce false contours of intensities 
o essential in composite filtering 


* multistage filters 
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Filtering 


u Box filter 
o smoothing filter 
o lowpass filter 
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Filtering 


= Box filter input 
o smoothing filter ши ш Ш Dd FI 


o lowpass filter а 
өө 


о averaging filter == == 


WANG 


алаа 


sandhan@iitk.ac.in 


EE604: IMAGE PROCESSING 


Filtering 


u Box filter 
o smoothing filter 
o lowpass filter 
o averaging filter 


` гих и ~ В 


„а 


m-3 == ии === 


Жаа 
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input 


ЕНЕ XE 
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Filtering 


u Box filter 
o smoothing filter 
o lowpass filter 
o averaging filter 


ЕНЕЕ ~ В 


„а 


m-3 == ии === m=11 
— | | | | == 


Жаа 
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input 
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Filtering 


u Box filter 
o smoothing filter 
o lowpass filter 
o averaging filter 


m=3 


ЕНЕЕ ~ В 


wa 


= == ||| ||| ||| === 


Жаа 


ЕЕ604: IMAGE PROCESSING 


input 


2 БН 


UE 


wa 


243 


m-21 


. а ga 
аа 


Filtering 


= Gaussian filter 222 
o smoothing filter w(s,t)- С(5,() = Ke 27 
o defocused lens approximators 
| 
° response is independent of orientation 
° circulariv symmetric 


o isotropic 4.8976 
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Filtering 


= Gaussian filter 


gef 
o smoothing filter w(s,t) = G(s,t) = Ke 20” 0.3679 | 0.6065 | 0.3679 
о defocused lens approximators 
o isotropic 8. Х | 0.6065 | 1.0000 | 0.6065 


° response is independent of orientation 
° circularly symmetric 0.3679 | 0.6065 | 0.3679 
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Filtering 


= Gaussian filter 
o smoothing filter 


0.3679 | 0.6065 | 0.3679 
X | 0.6065 | 1.0000 | 0.6065 
° response is independent of orientation 
° circularly symmetric 0.3679 | 0.6065 | 0.3679 


о defocused lens approximators 


o isotropic 4.8976 
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Filtering 


input 


o isotropic = i === 1 4.8976 


a Gaussian filter 
o smoothing filter хихи ХШ 
о defocused lens approximators $66 a mmm 
X | 0.6065 | 1.0000 | 0.6065 
* response is independent of orientation =| = ; - 
° circularly symmetric VN ds З 
га add а а 
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F e It e 
| input 
u Gaussian filter 
о smoothing filter ` з ю (Х aM 0.3679 | 0.6065 | 0.3679 
o defocused lens approximators cee a 
O isotropic ==== I == i 4.8976 X | 0.6065 | 1.0000 | 0.6065 
e response is independent of orientation — = 
e circularly symmetric VN 


CON З 0.3679 | 0.6065 | 0.3679 
aaa ad ad a 


m-21 0=3.5 Gauss 
"з _ 4 m 


Sd 


2223 
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Filtering 


| input 
= Gaussian filter 
| | ^ m 

o smoothing filter = ах ш Ж 0.3679 | 0.6065 | 0.3679 
o defocused lens approximators 

| | еф 1 
O Isotropic == qu === i 4.8976 X | 0.6065 | 1.0000 | 0.6065 

e response is independent of orientation = | = 


° circularly symmetric ШЕ 


0.3679 | 0.6065 | 0.3679 
аааа аа 


m-21 box m-21 0=3.5 Gauss 
. ki B E sa BE 
сее а 11: а 


Zaa Zaa 
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Filtering 


| | input 
u Gaussian filter 
о smoothing filter зихи aM 0.3679 | 0.6065 | 0.3679 
o defocused lens approximators a 
| | сее 1 
O Isotropic == qu == | 4.8976 X | 0.6065 | 1.0000 | 0.6065 


* response is independent of orientation =| = | 
° circularly symmetric JEN $ 0.3679 | 0.6065 | 0.3679 


аааа а 
m-21 box m-21 0=3.5 Gauss (11-43 657 Gauss 
" B E sa BE . * m a 


wawa да 


Жазаа аа (ааа 
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Filtering 


= Gaussian filter 


o smoothing filter 
o defocused lens approximators 


o isotropic 


° response is independent of orientation 


° circularly symmetric 


m=21 box 
‘es в E n eek NI 
EE 315 
— |1111 === = |1111 == 
У WANG 
заааааа .,ааа 
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input 
"m8 И 


mel 


= |11111 = 


MW 


a a ard 


m-21 0=3.5 Gauss 


ad 


>x m 


aa 


m=43 о<7 Gauss 


0.3679 | 0.6065 | 0.3679 
Х | 0.6065 | 1.0000 | 0.6065 
0.3679 | 0.6065 | 0.3679 


m-21 box 


4.8976 


„а 


MLN 


à à a a 


r-— — 
a š Е 


wa 


аа aa 


Filtering 


| input 
u Gaussian filter 
^ m 
o smoothing filter “а хш Ж 0.3679 | 0.6065 | 0.3679 
o defocused lens approximators 
| | сее 1 
O Isotropic == qu == | 4.8976 X | 0.6065 | 1.0000 | 0.6065 


* response is independent of orientation — = | | | | |== == 


° circularly symmetric JEN? 


0.3679 | 0.6065 | 0.3679 
аааа аа 


те43 o=7 Gauss m=21 box 


мэс. oo: Gf 


CMM ака 


“aa Заа 
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Filtering 


| input 
u Gaussian filter 
o smoothing filter ` "ú XEXE 
o defocused lens approximators a 
eee 


o isotropic — 
response is independent of orientation 


== — == 


“ circularly symmetric WANG 


аа ааа 


m-85 657 Gauss 


prong 


а 


JUSS 


| a à a a 
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аа. 


аа 


(11-43 о<7 Gauss 


0.3679 | 0.6065 | 0.3679 
Х | 0.6065 | 1.0000 | 0.6065 
0.3679 | 0.6065 | 0.3679 


m-21 box 


4.8976 


.. ш 
== 11 == 
JUSS 


aaa a 


— m 
Ш в BN 


^d 


аа as 
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Filtering 


u Gaussian filter 
: : «3 Ш г > 
o smoothing filter > x w x = 0.3679 | 0.6065 | 0.3679 
o defocused lens approximators a 
f f сее 
o Isotropic ш === 4.8976 X | 0.6065 | 1.0000 | 0.6065 
— | || == 


• геѕропѕе is independent of orientation 
° сисшапу symmetric VN | 0.3679 | 0.6065 | 0.3679 
aad a a a a 


11-85 627 Gauss m=43 o=7 Gauss m=21 box 


difference mgs — M43 


ZON ZON Ж 
заааа заааа aaaad 
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Filtering 


u Box vs Gaussian 
o blur profile 
o blurred rects having same shape 
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Filtering 


u Box VS Gaussian 
o blur profile 


o blurred rects having same shape 
пт 71 box 
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Filtering 


u BOX VS Gaussian 
o blur profile 


o blurred rects having same shape 
пт 71 box m-151 о-25 Gauss 
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Filtering 


u Padding effects 


m-187 6531 Gauss 


image 1024x1024 
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Filtering 
mirror replicate 


u Padding effects 


m-187 6531 Gauss 


image 1024x1024 
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Filtering 


mirror replicate 
^ _ ^" _ 
` ` 


u Padding effects 


m-187 o=31 Gauss 


image 1024x1024 


u Relative size effect 


m-187 o=31 Gauss 


image 4096x4096 
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Filtering 


u Padding effects 


m-187 6531 Gauss 


image 1024x1024 


u Relative size effect 


m-187 6531 Gauss 


image 4096x4096 
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mirror 


ши „ ex В · BH = Ш 


oO sad 


AN, 


aaaad аааа а 


replicate 
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Filtering 


mirror 
u Padding effects 


m-187 6531 Gauss 


image 1024x1024 


u Relative size effect 


m-187 6531 Gauss “яа IDXA Ма ы 


image 4096х4096 өөө а eee a 


Sao === 


m=745 o=124 Gauss === 


ЛАА, аа а а а а а 
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Filtering 


u Padding effects 


m-187 6531 Gauss 


image 1024x1024 


u Relative size effect 


m-18/ о-31 Gauss 
image 4096x4096 


те745 с-124 Gauss 
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mirror 


input m=187 о-31 
ээн > . Е = 


EM NE 


===== uu === 


ЛАА, аа а aaad 


replicate 


m-745 c-124 
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Filtering 


u Relevant region extraction 
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Filtering 


Relevant region extraction 


ЕЕ604: IMAGE PROCESSING sandhan@iitk.ac.in 


Filtering 


Relevant region extraction 
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Filtering 


Relevant region extraction 
filtering thresholding 


ЕЕ604: IMAGE PROCESSING sandhan@iitk.ac.in 


Filtering 


= Shifting 
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Filtering 


= Shifting 


filter output 
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Filtering 


= Shifting 


filter output 
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Filtering 


u Shading correction 
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Filtering 


u Shading correction 
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Filtering 


u Shading correction 
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Filtering 


u Shading correction 
filtering scaling 
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Conclusion 


Filtering 


Separable kernels 
Correlation Vs Convolution 
Filter properties 


Smoothing filters 


Filtering 
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credit: S. Bidun’20 


